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ABS^SACO: 

The major purposes of the study were to determine (1) 
the extent to which students receiving College Level. Examination 
Program (CLIP) credit in mathematics pursue courses in the 
disciplines / (2) their achievement in advanced mathematics courses 
compared to other students of similar academic ability* and (3) the 
potential loss of course credit hours which otherwise may have been 
generated. It was found that the policy for awarding credit was 
educationally sound and the potential loss of course credit hours was 
prohahly no more than 20 per cent of the total awarded. 
(Author/EC) t-:.- ' 
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The emergince of the College Level Examination Pr^ogram {CLEP)--tha 
General EKamlnatlons (GEs) 1n part1cular--has made cred1t-by-exami nation a 
viable option for significant numbers of students* However^ Institutional 
LO attempts to evaluate local policies for awarding credit have bein minimal 

and have paid little attention to the subsequent course work and achievement 
fs^ of students who receive CLEP credit. In the Srandy and Shea (1976) survey 

} ^20 per cent of. the respondents (all with CLEP policies) reported having 
r-H conducted studies related to the GEs and less than 15 

_ having done any research on the nature of thi later course work and achievement 

Ltj of students receiving credit. In the studies which had been don® students 

garierally tended to pursue further course wofk fn the areas of CLEP Credit with 
the exception of Social Science/History, and, in terms of overall achievement, 
generally received significantly better grades^ although the extent to which 
academic apt1 tude, was controlled is questipnabl a* In addition to these 
" educational issues there is the management question of Impact on academic 
departments In terms of loss of credit hours* Failure to attend to this 
faculty concern is tantamount to ignoring the political reality of thii 
decision-making structure in formulating policies for credlt-by-exami nation* 
^ This study examines both the educational and the management issues as theyv \ 

relate to the CLEP GE In mathematics. 

The present CLEP policy at our institution was adopted in 1972* 
According to that policy students may earn a maximum of 6 hours crecft for 
each, of four General Examinations : Natural Science, Mathematics s Humanities, 
and Social Science/History, V (The criterion score is approximately 490 for 
each GEj Since the policy was implemented, approximately 3800 students, 
predominantly new freshmen, have taken the GEs. Earlier institutional studies 
have shown that a typical CLEP candidate will attempt 3 of the 4 GEs, Although 
academic ability, as measured by the ACT Composite standard score, was similar 
for the groups of students registered for each GE, the passing rates varied 
cons1derably--from a high of 71 per cent in Mathematics to a low of 39 per cent 
in Humanities. (For a discussion of the relationship between ACT and CLEP 
performance, see Halinski and Vogel, in press.) The relatively high passing 
rate In mathematics raised questions regarding the educational efficacy of the 
CLEP policy with regards to mathematics and the potential impact of the policy 
upon the Department of Mathematics* Specific questions addressed were: 



(1) For students receiving CLEP credit in mathematics, how does the number 
of college mathematics course hours registered for and completed compare 
to that of other students?' 



Presented at the annual meeting of the National Council on Measurement in 
Education, New York, N.Y., April, 1977. ^ 

^There are no restrictions as such on whieh courses students with CLEP credit can 
take. The policy statement reads r '^Students who are awarded credit in one or more 
areas of the General Examinations are expected to consult with their advisors to 
determine which basic courses and which advanced courses are most appropriate to 
meet their educational needs," 
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(2) For those students who receive CLEP credit in mathematics and pursue 
subsequent coursework in the subject ^ how does their performance 
compare with that of other students? 

(3) What is the potential annual loss in credit hours to the Department of 
Mathematics under the present policy? 



Procedure 

A data base was created for 3486 students admitted to ISU directly from 
high school for the fall of 1973* The data base consisted of a student*s 
ACT standard scores * sex^ major in the fall of ISJS, major in the springs 1976s 
mathematics courses registered for and completed by semester through the spring 
of 1976 (listed by course number and credit hours) j mathematics course grades ^ 
CLEP standard score In mathematics (when appltcabli) and the amount of CLEP 
credit awarded in mathematics. The mathematics courses were also divided into 
Level I and Level II courses. Level I courses were defined as those beginning 
courses normally enrolled in by non-mathematics majors, e*g* Foundation Topics 
In Mathematfcs I Applications of Elementary Mathematics ^ Modern College Algebra 
with Trigonometry t Finite Mathematics for Business and Social Sciences. - 
Courses requiring competence beyond this level v/ere defined as Level 11 courses. 
For convenience s students receivTng 6 hours of CLEP credit in mathematics were 
labeled the "CLEP Group''. All students without CLEP credit in mathematics were 
labeled the "Mon-CLEP Group". 

Comparisons were made using three designs. In Design I the sample of 
3486 students was partitioned ictto two groups: CLEP and Non-CLEP. In Design II 
a subsample was taken from each of these groups, the condition for selection 
being that the students ACT Mathematics standard score was 25 or greater 
(ACTM5'25), (As a point of reference^ this cutoff score eliminated the bottom 
two-thirds of the freshman class from the analysis ^ almost all of whom were 
in the Mon-CLEP group.) In Design III 211 CLEP students from the original 
sample were matched by ACTM score i sex and major (as of the Spring, 1976 semester 
to Mon-CLEP students/ 

Once the data base had been creattd^ a simple tabulation provided the 
results for describing the number of mathernatics course hours enrolled for and : 
...completed by level. 

The question relating to performance was dealt with in two ways for 
Designs I and II. First, a t-test for independent groups was used with 
mathematics QPA as a dependent variable. This was followed by a multiple 
regression analysis with mathematics GPA again the dependent variable and ACTM, 
SEX and GROUP (CLEP vs Mon-CLEP) as the independent variables. This full model 
was compared to a reduced model In which the GROUP varlabli was^ deleted to 
test for the significance of the difference in QPA. In Design -III a t-test 
for dependent groups was used. Since no specific number of course hours in 
mathematics is required^ all 'students did not have a mathematics GPA and only 
those who did were Included 1n these comparisons. Further, in Design III If 
one member of a matched pair did not have a mathematics GPA, that pair was , 
deleted from the analysis. / 



- V To estimate the potential loss in credit hours to the. Departmeht of 
Mathematics in Designs I & Tli it was first determined what percentage of 
Non-'CLEP students had not registered for any hours of mathematics course work 
for each ACTM unit score interval. Then for the Non-CLEP students who had:; 
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registered for mathtmatlcs coursas, the course hours were regressed on ACTM 
score and SEX, The regression equations were then applied to the appropriate 
CLEP groups to estimate the number of hours of course work expected if all 
CLEP students registered for courses . Under the assumption that without the 
prdficiency credit the proportion of CLEP students at each ACTM score interval 
not registering for courses would be the same as that for the Non-CLEP students, 
an estimate was made of the proportion of CLEP students who would not be 
expected to enroll in any mathematics courses. (There were separate estimates 
for Designs I and IL) The hours calculated through the regression equations 
were then reduced by these proportions. The hours thus calculated vyere 
then compared to the actual hours registered for, In Design III the estimate 
of potential loss was more straightforward: The CLEP and Non-CLEP groups 
were directly compared in terms of mathematics course hours registered for. 



Results and Oiscussion 

The results in Table 1 show that the CLEP groyp was markedly superior 
to freshmen In general in terms of developed mathematical ability and overall 



Table 1. Sample Size, ACT Results and Proportion of Females for Each of'Three Designs 





Sample 


Prop of 
Females 


Mean No . of 


ACT Math 


ACT Comp 




Size 


Semesters in 
School 


Mean 


SD 


Mean 


SD - 


Design I (Entire Sample) 
CLEP 

Non-CLEP 


, 342 
3,144 


.59 

.62. 


5.2 
4.5 


29.1 
20.6 


3.2 
6.5 


26.7 
20.5 


2.6 
4.9 


Design 11 (ACTM 2S) 
CLEP 

Non-CLEP 


309 
,917 


,60 
.54 


5.3 
4.8 


29.6 
28.0 


2.4 
2.2 


26.9 
24.7 


2.3 
2,9 


Design III (Matched Pairs) 
CLEP 

Non-CLEP 


21 1 
211 


.63 
.61 


6.0 
6.0 


28.7 
28.4 


3.1 
2.9 


26.5 
25.3 


2.7 
2.8 



academic ability (Design I). For the CLEP group the mean ACT Mathematics score 
was 29,1 and the mean ACT Composite was 26.7* For the Non-CLEP students, the 
respective means were 20.6 and 20,5. Additional ly, the variability 1n the 
scores of the Non-CLEP group along these two dimensions was twice as large 
as that for the CLEP group. These differences in the two groups, along with 
a concern for the effect of a student's m&jor on the dependent variables^ 
motivated the parallel analysis in Designs II and III. It can be observed 
that by going to Design IIj the two groups were more nearly comparable with 
only 10 per cent of the original CLEP sample being lost. Design III provides 
a control on major with near equality on the ACTM dimension but at a loss of 38 
per cent of the original CLEP sample. It is also of interest to note that the 
mean number of semesters in school is higher for the CLEP group in Designs I 
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and II. This is consistent with other Institutional studies conducted which 
showed that students who received CLEP credit were more likely to remain at 
the university, (This phanomena does not show up 1n Design III since students 
were matched on their Spring 5 1976 major which was considered to be a more 
.definite commitment to a field of study than the major upon entrance to the 
university.) 

In terms of course hour registration^ the risults In Table 2 show that 
a CLEP student registers for and completes, on the average^ more hours of 



Table 2» Mathematics Coursewor 


k for CLEP and Non-CLEP Groups 








No. of 


Course Hours 


% of Regis tired Hours 




CLEP 


Non-CLEP 


CLEP 


Non-CLEP 


Design I (Entire Sample) 










Level I (Completed Hours) 


384 


6,913 


191 


49% 


Level 11 (Completed Hours) 


1 ,286 


3,954 


63 


28 


Withdrawals/ Incompletes 


358 


3,218 


18 


23 


Registered Hours 










Total 


2,028 


14,085 


100% 


100% 


Mean 


5.93 


4.48 






Completed Hours 




10,867 




• ■ • 


Total 


1 ,670 






Mean 


4.88 


3.46 






Design 11 (ACTMS^SS) 










Level I (Completed Hours) 


315 


2.157 


17% 


38% 


Level II (Completed Hours) 


1 ,242 


2334 


67 


46 


Wi thdrawal s/ Incompl etes 


304 


878 


16 


16 


Registered Hours 










Total 


1 jOO 1 


□ sQ&y 


100% 


100% 


rIBrtn 


6.02 


6.18 






Completed Hours 










Total 


1,557 


4,791 






Mean 


5.04 


5.22 






Design III (Matchid Pairs) — 










Livel I '(Completed Hours) 


255 


638 


21% 


40% 


Level 11 (Completed Hours) 


770 


785 


63 


49 


Withdrawals/ Incompl etes . 


196 


168 


16 


n 


Registered Hours 
Total 


1.221 


1,591 ' 


1001 


100% 


Mean 


5.79 


7.54 






Completed Hours 










Total 


1 ,025 


1 ,425 






Mean 


4.86 


6.75 
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math«nat1cs than the typical Non-CLEP students with the bulk of tht courses 
being Level 11 (Design I), Whin the anaTysIs Is confined to studints with 
ACTM" scores of 25 or greater (Design II) ^ the CLEP students^ again on the 
averages register for and complete almost as many course hours as the Non-CLEP 
students. However, In Design III there is a marked difference between the 
two groups In the course hours registered for and completed with the advantage 
favoring the Non-CLEP students. In all three designs^ though ^ there 1s a 
stronger tendency for CLEP students to take Level 11 courses which is In 
keeping with the rationale that the student's program should build upon the 
proficiency credit and not duplicate 1t^ 

With respect to perforwiance In mathematics courses without controlling 
or? ACTM. and SEX (see Table 3), the mean GPA of the CLEP students 1s significantly 



Table 3. p erformance in Mathematics Courses as iMeasured by Mean GPA 



Sample Size Mean Std . Dev . t 

Design I (Entire Sample) . 
Level I Courses 



CLEP 


91 


2.91 


1 .06 


6.19* 


Non-CLEP 


1 ,588 


2.18 


1.10 




Level II Courses 










CLEP 


138 


2.83 


1.17 


1.65 (n.s.) 


Non-CLEP 


636 


2.67 


1.03 




Level r & n Courses Coinblnid 










CLEP 


U : 


2.80 


1 .08 


6.97* 


Non-CLEP- 


1 ,805 


2.23 


1.14 




ign II (ACTM5.2S) 










Level I Courses 










CLEP 


77 


2.93 


1 .06 


1 .90 (n.s.) 


Non-CLEP 


510 


2.70 


.99 


Level il Courses 










CLEP 


130 


2.85 


1.14 


0.86 (n.s.) 


Non-CLEP 


377 


2.76 


.99 




Level I & II Courses Combined 










CLEP 


176 


2.81 


1 .13 


1.62 (n.s.) 


Non-CLEP 


685 


2.68 


.96 




grt III (Matched Pairs) 










Level I a II Courses Combined 










CLEP 


117 


3.01 


.99 


1 .16 (n.s.) 


Non-CLEP 


117 


2.87 


.89 



*p< .001 



0 
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higher (p< . 001) than that of Non-CLEP studints for Level I courses and for 
Level I and 11 courses combined. The SPA in Level 11 courses was also higher 
for the CLEP group, but the difference was not considered to be statistically 
significant. With partial control on ACTM (Design II), the mean GPA for 
CLEP students v^as higher for Level I courses ^ Level II courses, and Level I 
and n combinad; but^ again , the differences were not considered to be 
statistically significant. With control on ACTM, SeXs and Major (Design III), 
the GPA for the CLEP students was higher for Level I and II combined; but, 
once again s the difference was not statistically significant. Comparisons 
were not made in Design III for Level I courses and Level II courses separately 
because palrwise deletion when one GPA was missing resulted in unduly small 
sample sizes- 

The regression results in Table 4 show that in both Designs I & II the 
mean GPA in mathematics Is significantly related to ACTM, SEX, and GROUP 
membership for Level I courses. Level 11 courses and Level I and 11 courses 
combined (p^/001)* However, examination of the F-values for the GROUP 
regression weight shows-Wat variable could be deleted from the model without 
significantly reducing the multiple R-values in each instance* In other 
words when controlling for differences in ACTM and Sex, there is no significant 
difference in mean GPA between the CLEP and Non-CLEP groups. ' ^ ^/z-: 



these results 1n Tables 3 and 4 suggest is that CLEP students 
generally do as wall in their mathematics coursework as do other students of 



Table 4. Regression Results for Comparison of Mean GPA's When Controlling for ACTM and Sex 



DESIGN I D E S I G N I I 

Courses Variables N b R^ T ~ . F^ R^ F^ 

Level I & II 186S ,46 163.9* 847 .30 28.5* 

(combined) ACTM .08 419.2* .08 33.1* 

SEX .39 71.5* ,50 57*0* 

GROUP .00 0.0 -,02 0.0 

Level I 1563 ,47 145,4* 579 .30 19.1* 

.08 376.6* ,10 25.4* 



SEX ' .31 35.8* .46 31,3* 

GROUP .16 2.1 ,07 0,3 

Level II 731 ,35 33.5* 497 .31 17,6* 

.04 25.7* ,07 12.5* 



SEX .66 83.0* ,58 42, ff*^ 

GROUP -.09 0.8 ^ -,08 0.5 

^The F refers to the test of significance for the regression weight 
t^The R-value 1s for the full model 

^The F refers to the test of significance for the full model R-value 
*p< .001 

Note: In the vector SEX,. l^Female, 0-Male 

In the vector GROUP, l^CLEP, O^Non-CLEP 



similar academic ability. Further ^ when the performance data is viewed in the 
context of/ the course registration data, the relatively sman amount of Level I 
coursewor^' taken by CLEP students does not impair their performance in Level 11 
coursewprJc, It also appears evident that studies which compare the performance 
of CLEP and Non-CLEP students must take into account the initial ability levels 
of the two, groups* Otherwise the case for the CLEP students will generally be 
overstated* 

The last question to be addressed is the potential credit hour loss to 
the Department of Hathematics* For Design I & II the estimated hours of 
mathematics course registration (y) was calculated as followsi 

y^q*N (bg+bi*A^+b^*SlX) 

where q^estimated proportion of CLEP students expected to register for 
mathematics courses 
N-number of students in the CLEP group 

b_p b^s b_^raw rigresslon weights derived from the Non-CLEP group 
ACTM^ean ACTM for the CLEP group 

SEX-proport1on of females in the CLEP group 

For Design I, the calculation v/as 

y^, 833*342 (5.50+,121*29 J-Z,S0*,S9) 
y^21S0 

For Design II , the calculation was 

y^. 841*309 (-7.38+. 584*29. 652. 37*. 60) 
y^22Q0 

* ,, 

The comparison of estimated hours and actual hours is presented in 
Table 5, In Design I the CLEP students registered for 6 per cent fewer hours 
than estimated; in Design 11, 15 per cent fewer hours; and in Design III, 23 
per cent fewer hours. Design I most likely underestimates considerably the 
mathematics course hours CLEP students would take had they not had the CLEP 
credits the reason being that the estimating formula is heavily influenced by 
students with lower ACTM scores and these students tend to take fewer 
mathematics courses. On the other hand Design in spmewhat overestimates the 
potential loss of hours to the department since it does not take Into account 
the greater holding power of the university for tha CLEP group. (This results 
from matching on spring 1976 major J Given these considerations our conclusion 
is that the CLEP students ^ as a result of the proficiency credit received , take 
15-20 per cent fewer hours in Mathematics than they otherwise would. 

In summary, the awarding of CLEP credit in mathematics did not result 
in a large scale avoidance of college courses in the discipline by students 
receiving the credit. These students were a highly selective group in terms 
of developed mathematical ability and compared favorably to other students of 
s1milar_academ1c ability in terms of course enrollment in mathamatlcs: and 
course completion. While some opted for no further work IrT^the area, it was \ 
essentially the Level I courses which were bypassed. Where students did 
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Table 5. Estimates of the, PotentlaV Loss of Credit Hours to the Department 

of Mithematics ^ 



_ Mathemat^ics Course Hour Registration 

CLEP CLEP 

(Estimated Hours) (Actual Hours) D1ff % Loss 

(1) (2) (3)^(l)-(2) (3)^(1) 



Design I 



2150 



2028 



122 



Design II 
Design III^®^ 



2200 



1591 



186T 



1221 



339 



370 



15 
23 



^In Design III the estimated hours for the CLEP group Is the actual course 
hour registration for the Non-CLEP group. 



pursue further course work in mathematics --and the majority d1d--the general 
tendency was to enroll directly in Level II courses with apparently no 
deleterious effects on their achievement, Finallyp 1t was estimated that the 
loss in credit hours to the Department of Mathematics amounts to 15-20 per 
cent of the hours the CLEP students would have been expected to generate had 
no proficiency credit been awarded. 
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